Papers with transformer attention mechanism
Exploiting Positional Bias for Query-Agnostic Generative Content in Search (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that neural ranking models outperform lexical models in text retrieval. |
| Approach: | They propose to exploit transformer attention mechanism to induce exploitable defects in search models through sensitivity to token position within a sequence. |
| Outcome: | The proposed model can generalise beyond a single query or topic without knowledge of topicality. |